Local stability in a transient Markov chain
نویسندگان
چکیده
منابع مشابه
Relative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain
In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...
متن کاملThe Key Renewal Theorem for a Transient Markov Chain
provided Eξ1 is finite and positive (see, for example, Feller and Orey [8], Feller [7, Ch. XI], Woodroofe [25, Appendix]); F is called lattice if it is concentrated on some lattice {ka, k ∈ Z} with a > 0. If F is lattice the same is true when h is a multiple of the span a. It is proved in Wang and Woodroofe [23] and in Borovkov and Foss [5, Theorem 2.6] that (1) holds uniformly over certain cla...
متن کاملA statistical Markov chain approximation of transient hospital inpatient inventory
Inventory levels are critical to the operations, management, and capacity decisions of inventory systems but can be difficult to model in heterogeneous, non-stationary throughput systems. The inpatient hospital is a complicated throughput system and, like most inventory systems, hospitals dynamically make managerial decisions based on short term subjective demand predictions. Specifically, shor...
متن کاملA Transient Markov Chain With Finitely Many Cutpoints
We give an example of a transient reversible Markov chain that a.s. has only a finite number of cutpoints. We explain how this is relevant to a conjecture of Diaconis and Freedman and a question of Kaimanovich. We also answer Kaimanovich’s question when the Markov chain is a nearest-neighbor random walk on a tree.
متن کاملregression analysis in markov chain
in a finite stationary markov chain, transition probabilities may depend on some explanatoryvariables. a similar problem has been considered here. the corresponding posteriors are derived andinferences are done using these posteriors. finally, the procedure is illustrated with a real example.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Statistics & Probability Letters
سال: 2020
ISSN: 0167-7152
DOI: 10.1016/j.spl.2020.108855